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the  usual  methods  of  solution  only  an  approximate  solution  can 
be  obtained.  In  this  thesis  we  present  algorithms  for  obtaining 
the  exact  solution  to  Lyapunov's  Equation,  using  Algebraic 
Methods . 
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Chapter  1 
Intruduction 

1 . L Ceneral  Remarks 

In  recent  years  there  has  been  impressive  progress  in  the  i 

theoretical  understanding  of  the  structure,  representation  and 
control  of  linear  multivariable  systems.  In  contrast , workers 
in  the  field  have  paid  very  little  attention  tc  the  computa- 
tional aspects  of  systems  problems.  This  does  not  mean  that 
algorithms  for  the  solution  of  systems  problems  have  not  been 
developed.  But  most  of  the  algorithms  that  have  been  proposed 
hivo  never  been  seriously  studied  as  far  as  stability,  conver- 

I 

gence  and  similar  issues  are  concerned. 

In  this  thesis  we  undertake  a study  of  solution  methods  i 

for  Lyapunov's  equation 

PA  + A'P  = -Q  (1.1)  I 

using  the  methods  of  modern  algebra.  The  emphasis  is  on  the  j 

use  of  finite  algebraic  procedures  which  are  easily  implemented 
on  a digital  computer  and  which  lead  to  an  explicit  solution  | 

to  the  problem.  j 

i 

1 . 2 Importance  of  Equation 

It  is  well  known  that  this  is  an  important  equation  in  the 
study  of  stability  of  linear  finite  dimensional  time-invariant 
systems.  If  Q is  symmetric  and  positive  definite  and  if  A is  a | 

stability  matrix  (real  parts  of  eigen-values  of  A strictly  j 

negative)  then  the  unique  positive  definite  solution  to  (1.1) 
is  given  by  the  convergent  integral. 
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P = 


/ 


gA'  t.Q.eAt(3t_ 


(1.2) 


In  Optimal  Control  it  is  frequently  desired  to  evaluate 


quadratic  integrals  of  the  form 

00 


J = 


/ 


x'  (t) *Q"X (t)dt 


(1.3) 


under  the  constraint  that  x(t)  satisfies 
x(t)  =Ax(t)  x(0)  “C 


If  P is  the  solution  of  equation  (1.1)  we  have  that 

J = c' -P.c  . (1.4) 

Stochastic  control  is  another  area  of  importance  in  the 
evaluation  of  covariance  matrices  in  filtering  and  estimation 
for  continuous  systems. 

The  need  for  solving  this  equation  also  arises  when  one 
uses  Newton's  Method  to  solve  the  Algebraic  Riccati  equation 
PA  + A'P  + c'c  - PBR~^B’P  =0  (1.5) 

where  R is  positive  definite. 

If  (A,B)  is  a controllable  pair  and  (A,C)  an  observable 
pair  then  there  exists  a unique  positive  definite  solution  P to 
(1.5)  . 


In  riO]  it  is  shown  that  if  Pj^,  k=0,  1,2...  is  the 
unique  positive  definite  solution  of  the  linear  algebraic  matrix 
equation 

^ Pk^'k  ^ = 


0 


(1.6) 
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whoro  rocursivoly , 

R-ln'Pj^_^  k - 1,2,... 

Ajj  = A -BL]^ 

whore  Lq  is  chosen  such  that  the  matrix  A^  = A - BLq  is  a 
stability  matrix  then 

' ) p 4 ^ ^ ^ . . . k = 0 , 1 , 2 , . . . 

ii)  lim  Pj^  = P 
k — oo 

Equation  (1.6)  with  k=0,  1,  2,  ...  is  a Lyapunov  equation. 
1 . 3 Methods  of  Solution 

The  Lyapunov  equation  has  many  areas  of  application  and 
therefore  a great  deal  of  effort  has  been  put  in  both  the  theo- 
retical as  well  as  its  computational  aspects.  There  have  been 
devised  several  methods  of  solution  which  can  broadly  be  charac- 
terized as  either  Direct,  Transformation  or  Numerical.  An 
exposition  accompanied  by  error  analysis  of  several  such  methods 
is  contained  in  f 1,  2 1 . 

The  basic  drawback  with  such  methods  is  the  fact  that  the 
solution  obtained  is  an  approximate  one.  This  becomes  frustra- 
ting when  the  problem  is  ill-conditioned.  Furthermore  if  a 
Riccati  equation  is  to  be  solved  which  requires  the  solution  of 
several  Lyapunov  equations  the  matter  becomes  even  more  compli- 
cated. Not  only  is  the  solution  an  approximate  one  but  nothing 
is  said  about  the  accuracy  of  the  approximation. 

The  need  for  improvement  is  quite  evident  and  in  certain 
cases  demanded.  In  this  thesis  we  have  developed  new  algorithms 
for  obtaining  the  exact  solution  of  the  Lyapunov  equation. 


1 . 4 Suminary  _o f _Th^es i_s 

I,ut  A'P  + PA  ^ -^)  1"'0  1 Lypunov  equation  with  A being  a 

stability  matrix  and  both  A and  Q n dimensional  matrices 

with  real  entries.  Let  R(x,yl  be  the  ring  of  polynomials  in 
X and  y over  the  reals  R,  and  f1  be  the  set  of  all  nxn  square 
matrices  over  the  reals.  The  solution  P of  this  equation  is 

qivi'ii  iDy  ' 

I-  - f^(q  (x,y)  ,Q)  i 

wtiere  q (x  , y ) in  R I X , y I \ 

and  f^:  K)x,yl  x defined  as  ] 

f,(h(x,y),M)  = h (A')  j-M-  (A)>^  | 

^ ^ Ik  j 

j ,k  - 

t 

( 

This  method  is  based  on  an  important  paper  by  KALMAN  i 

I 91  . Kalman's  concern  was  the  characterization  of  polynomials  ; 

i 

wiiose  zeros  lie  in  certain  algebraic  domains  (and  the  unification  j 

o(  t tie  ideas  of  Hot  mite  and  Lyapunov).  In  this  thesis  we  clarify 

and  complete  some  ideas  contained  in  the  paper  and  extend  the 

results  by  showing  that  the  same  ideas  lead  to  finite  algorithms  i 

lor  the  solution  of  Linear  Matrix  Equations. 

The  thesis  is  divided  into  four  chapters.  In  chapter  2 we 
introduce  the  algebraic  structure  in  which  we  will  be  working  and 
provide  proofs  of  several  theorems  related  to  a linear  matrix 
f'Muation.  This  chapter  provides  the  basis  for  chapter  3 where 
the  computational  algorithms  are  presented.  In  chapter  4 we  list 
the  computer  programs  used  in  implementing  the  algorithms  and 
firesent  several  numerical  examples.  In  chapter  5 we  present 

some  generalizations  and  extensions.  ' 
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Chapter  2 

Algebraic  Structure 

2 . 1 Introduction 

This  chapter  provides  the  theoretical  basis  on  which  our 
method  for  solving  the  Lyapunov  Equation  lies. 

There  are  two  main  themes.  The  first  one  is  the  association 
of  a unique  matrix  with  every  polynomial  in  R[x,y]  and  the  notion 
of  a positive  polynomial.  Lemmata  (2 . 1 ) , ( 2 . 2 ) , ( 2 . 3 ) and  part 
(iii)  of  Lemma  (2.4)  refer  to  this  idea.  The  above  four  Lemmata 
j are  stated  in  section  (2.2)  but  their  proof  is  presented  in 

I Appendix  A. 

^ The  second  theme  is  that  of  the  action  f^  which  is  examined 

f 

^ in  section  (2.3)  . 

I The  above  two  themes  are  used  in  proving  the  two  theorems  in 

> section  (2.4),  which  are  related  to  the  Lyapunov  Equation. 

^ 2.2  Four  Lemmata  from  the  Theory  of  Matrices  and  Polynomials 

i 

; Let  R be  the  field  of  real  numbers  R[x]  the  ring  of  polynomials 

, in  X over  R and  R[x,yl  the  ring  of  polynomials  in  x and  y over  R. 

r 

f The  elements  of  Rfx]  are  denoted  as  p(x)  and  the  elements  of 

( 

i Rrx,y!  as  h(x,y).  R[x]  is  a subring  of  R[x,y]. 


Suppose  that  p(x,y)  is  in  R[x,y]  and  l(z)  is  the  column  vec- 
tor 


Then  we  can  write 


p (x,y)  = 1 ' (y)  -C  (p)  • 1 (x) 

for  some  unique  nxn  matrix  C (p)  = (a  ) . (The  element  a^^  is  the 
coefficient  of  the  term  x^~^*yi~l  in  p(x,y)).  If  n is  allowed 
to  take  a value  larqer  than  the  one  defined  above  for  any  par- 
ticular p(x,y)  the  uniqueness  of  C(p)  is  lost. 

We  therefore  can  associate  a unique  matrix  C(p)  with  any  poly- 
nomial p(x,y).  The  reason  behind  this  association  is  the  intent 
of  assigning  polynomials  to  value  classes. 

Definition  2.1.  A polynomial  p(x,y)  in  R[x,y]  is  positive  if 

and  only  if  C(p)  is  (i)  symmetric  and  (ii)  positive  definite. 

Let  O denote  the  ideal  (cp(x),  cp(y))  in  R[x,y]. 

g(x»y)  g(x,y)  = a(x,y)cp(x)+b(x,y)(p(y)  for  any  V 
( a (x,y) ,b (x,y)  in  R[x,y]  ) 

Let  Rlx,y  l/<1>  denote  the  associated  quotient  ring.  The 
elements  of  R|x,y1/<I>  will  be  thought  of  as  cosets  or  as  equi- 
valence classes  (whichever  is  more  advantageous  at  a given  situa- 
tion) denoted  as  <I>+  p(x,y)  or  [p(x,y)]  respectively.  We  shall 
denote  by  p(x,y)mod<I>  the  polynomial  of  minimal  degree  in  the  equi- 
valence class  [p(x,y)]. 

Let  Rj^(x)  denote  the  vector  space  over  R of  all  polynomials 
of  degree  less  than  m in  R[x]. 

Lemma  2.1  . Let  p(x,y)  be  a polynomial  in  R(j{,y]  with  C(p)  being 
an  mxm  matrix  . Then  p(x,y)  is  positive  if  and  only  if  there 
exist  polynomials  (x)  , . . . . (x)  such  that 
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m 

P(x,y)  = (y) 

I . 1 

where  {rti(x)|  are  a basis  for  Rjp(x)  . 

Definition  2.2.  Two  polynomials  a(x),  b(x)  in  R[x]  are 
called  relatively  prime  if  there  exist  polynomials  TyCx)  and 
A^(x)  such  that  T^(x)a(x)  + A.^(x)b(x)  = u where  u is  a 
unit  in  R(x]. 

Lemma  2.2.  Let  n be  the  degree  of  cp(x)  . If  p(x,y)modiI>  is 
positive  of  degree  n-1  in  both  x and  y then  (o (x) o (y ) p (x , y) ) mod® 
is  positive  of  degree  n-1  in  x and  y,  if  and  only  if  a(x)  and 
cp(x)  are  relatively  prime. 

Lemma  2.3.  Let  , A-2  / • • • complex  numbers  which  are 

distinct  and  have  positive  real  parts.  Then  the  nxn  matrix 
An=  ( ir-j  is  hermitean  (A^  = A^  where  (*)  the  hermitean 

V Ai  '*"A.  j / 

adjoint)  positive  definite. 

Definition  2.3.  A polynomial  g(x,y)  is  called  symmetric  if 
C(g)  is  a symmetric  matrix. 

A polynomial  g(x,y)  is  symmetric  if  g^(x,y)  - g(x,y) 
where  g^(x,y)  is  that  polynomial  obtained  from  g(x,y)  by 
interchanging  x and  y. 

^Lemmata  2.1,  2.2  and  2.3  correspond  to  Lemmata  2,  3 and 
Main  Lemma  in  [9]  respectively,  2.1  and  2.3  being  the  same, 
with  the  idea  of  3 being  borrowed  from  KALMAN  [9],  to  arrive 
at  the  statement  of  Lemma  2.2.  Lemma  2.4  captures  the  essential 
idea  of  the  Theorem  in  [9].  In  Kalman's  paper  only  sketches  of  proofs 
art;  Riven.  Here  we  provide  complete  proofs. 


L 
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I .omnia Let  A be  an  nxn  stability  matrix  with 

';)v(x)  det  (Ix-A)  and  lot  <X>  ~ (W2(x)  , <P2  (y)  ) • Define 

iP]^(x)  ep2(-x)  (2.1) 

cP2  (x)  -CP2  (x)tpi  (y) 


%{x,y)  =- 


(2.2) 


X -I-  y 


i)  Polynomials  (pj^(x),  cp2(x)  are  relatively  prime.  That  is  there 
exist  Tjj(x),  \^{x)  in  R[x,y]  such  that 

T^(x)cpj^(x)  + i.^(x)cP2(x)  = u (2.3) 

where  u is  a unit  in  R[x,y]. 


ii)  P^(x,y)  is  an  element  of  R[x,y] 


iii)  Lot  qu(x,y)  = (x)  (y)  P(p(x,y)mod<l>  (2.4) 

Then  qy(x,y)  is  positive  of  degree  n-1  in  both  x and  y. 
2.3  Defining  the  action  f^ 


IjCt  A be  some  nxn  matrix  over  R with  (p(x)  = det  (Ix-A) 
being  its  characteristic  polynomial.  Let  W be  the  set  of  all 
nxn  matrices  over  R. 


We  define  the  action  f^:  Rfx , y ]xf^ -►f*  in  the  following 


manner . 


f a (h  (x,y)  ,M)  •-= 


E 


j. 


M*  (A) 


(2.6) 


j rk 


These  are  some  properties  of  this  map. 

i)  f(u,M)  =uM  (u  a unitinR(x,y]  ) 

ii)  fp^(g(x,y)  f h(x,y),M)  = f;^  (g  (x , y)  ,M)  -i-  f^(h(x,y),M) 

iii)  fp^(g  (x,y)q  (x,y)  ,M)  - f;^  (g  (x , y)  , f;^  (q  (x  , y)  ,M)  ) 

= f^ (q (x,y) , (g (x,y) ,M) ) 


J 
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iv)  f^(h(x,y),M)  ^ mod®,  M) 

v)  f;^(h(x,y)  ,Mi+M2)==  f^(h(x,y)  ,Mj^)  + f a (h  (x  , y ) ,M2 ) 


I’roperty  i)  follows  directly  from  the  definition. 
Property  ii)  is  shown  as  follows: 

Lot  P(x,y)  --  g(x,y)  + h(x,y) 

Pij  ---  gij  + hij 

fA<P(X'y)'M)  ^]^Pij  (A')i-  M • (A)  j 

ij 

- (^ij  + ( (A-  )i.  M . (A)  j) 

ij 


g^^  (A* ) i-  M • (A)  j 


ID 


^ hij  (A'  ) ^-  M • (A) 


ID 

=-  f^(g(x,y),M)  + f^(h(x,y),M) 
Property  iii)  is  shown  as  follows; 

Lot  p(x,y)  = g(x,y)q(x,y) 


P . 
Dk 


= gih‘3lm 


i+l=j 

h+m=k 


(p  y)  f M)  = Pjk  M -(A) 


jk 


X]  ( ^ih^^lm] 

jk  \i+l=j  / 

h+m=k 

f^(g(x,y),M)  = y^  g.j^  (A')^‘  M -{A)‘ 


^ihO  M .(A)k 


1.5 


l^(q(x,y),M)  -=  ^ (A’ ) (A)"' 

Now 

f‘/^(q(x»y)r  rA(q(x,y),M)  (a*  ) | ^ -m*  (a)"’ j • (a)  ^ 

ih  ' Im  ' 


suppose  that  we  write  this  sum  differently 
let  j = itl  k - m+h 

Then 

(q  (x,y)  , f^  (q  (x,y)  ,M)  ) (A’)3-m-(A)^ 

jk  I i+l=j 

\h  (-m-k 
f^  (p  (x,y)  ,M) 

siniilnrlv  f^(p(x,y),M)  = f^  (q  (x  , y ) , f^  (g  (x  , y ) , M)  ) 

Property  iv)  is  shown  as  follows: 

Let  h(x,y)  = h^(x,y)<p(x)  + h2(x,y)cp(y)  t r(x,y) 

'I’his  is  obtained  by  first  dividing  h(x,y)  by  cp(x)  and  fol- 
lowing that  dividing  the  remainder  by  >p(y).  This  means  that 
the  degree  of  r(x,y)  in  both  x and  y is  less  than  n.  This 
decomposition  of  h(x,y)  is  unique,  and  we  also  have  that 
r ( X , y ) = h mod  <!> 

f^(h(x,y),  M)  - f^(hj  (x,y)cp(x)  th2(x,y)cp(y)+r  (x,y)  ,M) 

= f^  (hj  ( x,y)  , f^((p(x)  ,M)  ) ^-f^  (h2  (x,y)  ,f^((p(y)  ,M)  ) 
+f^(r (x, y) ,M) 

((P(x)  , M)  M-(p(A)  = O 

r (n{y)  , M)  - cp(A'  ) *M  = 0 
A 

b/  the  Cayley-Hami Iton  Theorem. 
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There  f(5re 

(h(x,y),M)  - f, (h  modo,M) 

A A 

Property  v)  is  shown  as  follows: 


(x,y)  , M]^+M2) 


^ ^ ^ (A' ) ^ (M]^+M2)  a3 


ID 


'y  (A' ) (A' ) ^M2A^ 


ID 


- f^(h(x,y) ,M^)+  f^(h(x,y) ,M2) 


The  definition  of  f^  paves  the  way  for  the  construction 
of  a particular  module.  Define  the  product  (*)  between  cosets 
cl>  1 h(x,y)  and  nxn  matrices  M by: 

(<t>+h  (x  , y)  ) * M = ^ ] h^  . (A')^MA^ 

ij  ^ 

with  the  outcome  in  ^ . 

Property  iv)  ensures  that  the  product  is  well  defined  since 
it  does  not  matter  which  element  in  <I'+h(x,y)  we  use. 

Square  nxn  matrices  under  addition  form  an  abelian  group. 
Property  v)  makes  certain  that 
<I>+  h(x,y)*  (A+B)  = (4>+h  (x , y)  ) *A+ (<I>+h  (x , y)  *B  . 

Property  iii)  ensures  that 

(C>+h(x,y))*  [ (<I>+g  (x,y))*M  ] = [ (<I>+h  (x  ,y)  ) (4>+g  (x , y)  ) ] *M  . 

And  property  ii)  ensures  that 
[(<I>+h  (x , y ) ) + (<I>+g  (x  , y ) ) ] *M  = (<I)+h  (x , y ) ) *M  + (<1>+  g(x,y))*M. 

The  ring  R[x,y]/0  has  a nuit  element  <I>+1  and  we  have  from 
property  i)  that 
(<D+1)  *M  =M  . 


The  above  can  be  summarized  in 
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Lemma  2.5.  The  set  of  square  nxn  matrices  is  a module  over 
the  quotient  ring  Rfx,y]/<1>. 

Even  though  Lemma  2.5  will  not  be  explicitly  called  upon 
in  any  of  the  subsequent  proofs  it  none  the  less  gives  great 
insight  in  what  is  essentially  taking  place  and  the  rationale 
behind  thir-  method  of  approach  to  the  solution  of 
PA  + A' P = -Q  . 

The  matrix  P is  operated  on  by  the  matrix  A.  This  can  be 
expressed  as 

+ (x+y))*  P = PA  + A'P  = -Q. 

Suppose  that  a multiplicative  inverse  of  element  <I>+(x+y) 
is  found  in  Rrx,yV®  denoted  by  <I>+(x+y)~^  such  that 
(<I>  +(x+y)  )•(<!>  +(x+y)”^)  = ®+l 
We  would  then  have  the  following: 

(<5+(x+y)~l)*[<I>  +{x+y)*P]  = (<I>+(x+y)"l)  * (-Q) 

Because  of  the  properties  mentioned  above  this  can  be  written 
as 

r (®+ (x+y)  • (®+ (x+y)  ]*P  = (<I>+ (x+y)  ~^)  * (-Q) 

and  therefore 

P=  (<5+  (x+y)  “^)  *Q  . 

2 . 4 Algebraic  proofs  of  two  theorems  related  to  a Linear  Matrix 
System. 

We  now  have  all  the  necessary  algebraic  construction  to 
prove  the  following  two  theorems. 

Theorem  2.1.  Let  A be  an  nxn  square  matrix  over  the  reals. 

A is  a stability  matrix  if  and  only  if  for  any  symmetric  positive 
definite  matrix  Q there  exists  a unique  symmetric  positive 
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ilotinitc  solution  P to  the  matrix  equation 

PA  t-  A'P  - -Q  (2.7) 

T^hoorem 2.2.  Let  A be  an  nxn  square  matrix  over  the  reals. 

If  A is  a stability  matrix  and  (A,C)  is  an  observable  pair 
then  the  matrix  equation 

PA  + A'P  = -C'C  (C  is  pxn)  (2.8) 

has  a unique  symmetric  positive  definite  solution  P. 

Proof  of  Theorem  2.1.  Suppose  that  A is  an  nxn  stability 
matrix.  We  claim  that  for  any 

P = "V  ■ 'Ql> 

u 

is  the  unique  solution  of  PA  + A'P  = » where  f^  is  defined 

as  in  (2.6)  and  qy(x,y)  as  in  (2.4).  Using  the  properties  of 
action  f^  we  have 

PA  + A'P  = • (f^(qu(x,y)  ,0^)  *A  + A ' • f^  (q^  (x  , y ) , ) ) 

= >Qi)  ) 

1 

= ■ (£a(  (x+y)  'Ql)  ) ) 

= • (fA^  ) 

= • (f^(  (x>y)q^^(x,y)mod<D,Qj^)  ) 

=■  • {-u2.Q  )=  Q, 

Uniqueness  follows  by  observing  that  the  linear  operator 
defined  by 


L(P) 


PA  +A'P 


-1')- 


is  onto  since  no  restriction  was  placed  on  This  implies 

that  I.  is  one-one. 

We  now  show  that  P is  positive  definite. 

Since  q^(x,y)  is  positive  (Lemma  2.4)  this  implies  that 
(Lemma  2.1)  there  exist  polynomials  jn|(x)|  such  that 

(x)nj^(y) 

where  (x)|  is  a ^asis  for  Rj^(x). 

Therefore 


P - 


f,  (q„ (x,y) ,Q) 


2 A u 


i=l 

n 

~2  tii  (A*  ) 'Q-ni  (A) 

i=l 


Q) 


Since  Q is  symmetric  from  the  uniqueness  of  the  solution 

P we  also  have  P being  symmetric.  Since  Q^O  we  have  from 

the  last  expression  that  P is  at  least  positive  semi-definite. 

Suppose  therefore,  that  there  exists  an  n-vector  z^O 

such  that  z’Pz-O.  this  implies  that  n£(A)'z--0  for  all  l<i<n. 

The  polynomials  |n^(x)|  form  a basis  for  Rj^(x).  Therefore 

there  exist  constants  kj^,k2,...k  such  that 
n " ^ 

^k.„i(K)  . 1 

i^l 


n 

t,>  2^  kiHilx),  D-I 

L -1 

n 

^kin,i{A)  = I 
i 1 


(I  nxn  identity  matrix) 


£ 


(A)  • = I • : 


i = l 


Since?  Ti|(A)  - 0 for  ail  i,  the  left  hand  side  of  the  ' 
,il)ov('  (‘(inalit^  js  zero.  This  is  a contradiction  since  I is 
()o;;iLiv(?  definite.  Therefore  P is  positive  definite. 

Suppose  now  that  for  any  symmetric  positive  definite 
matrix  Q there  cxixts  a symmetric  positive  definite  solution 
r>  o f (2.8). 

Let  z be  some  eigenvector  corresponding  to  the  eigenvalue  A.. 
z'*Q-z  <0  (z  denotes  complex  conjugate) 

z ’ (PA+A*  P) z < 0 
z'P(Az)  + (Xz‘ )Pz  < 0 
(A+A)  z'Pz  < 0 
.since  P > 0 this  implies  that  Ah  A <0  ( ie  that 
Hc'(A)  < (I).  Therefore  A is  a stability  matrix.  This  comoletes 
the  proof  of  Theorem  2.1. 

Prf)or  of  Theorem  2.2. 


.Suppose  that  A is  an  nxn  stability  matrix.  Using  Lemma  2.4 
this  implies  that 


qu(x»y)  = T^  (x)  T^  (y)  Pep  (x,  y)  mod  <I> 


is  positive.  By  Lemma  2.1  q^j(x,y)  can  be  written  as: 


£ 


qu(5«»y)  = > rti(x)Ti^(y) 


i==l 


with  {r.£(x)}  being  a basis  for  R,^(x).  In  a way  similar  to 
the  proof  of  theorem  2.1  the  solution  P of  (2.8)  exists  and  can 


1 


b('  written  as  : 
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f^(qu(x,y),C'C) 


_ 1 


. (A'  ) C'Cnj^  (A) 


Since  C'C  > 0 we  have  that  for  any  n-vector  z and  I4i  4 n 


where  llzl  =( 


z'-"^  (A*  )C'Cn^  (A)  z = II  Cn^  (A)z  ||  ^ 0 
= ( . This  means  that  P > 0. 


Suppose  then  that  there  exists  z/0  such  that  z'*P*z  = 0. 
This  implies  that 

jjcTi^(A)z|j  = 0 for  1 < i < n 

^ Ciij^  (A)  z =0  for  1 < i < n 

Since  |n,i(x)[  are  a basis  for  Rj^(x)  there  exists  an  nxn 


matrix  K such  that; 


(x) 
Tt2  (x) 


L %(x)  j L " J 

which  is  shorthand  notation  for  the  n equations 

kiin.i(x)  + +•••+  ^in^n^x)  = 

for  1 < i < n 

with  (k^  ^ , k^  2' • * • ^i n)  being  the  i*"^  row  of  K. 

Now  then 

fA(kiiTii(x)  + k^2^2^x)  +...  + kj^pTXj^(x),  I ) =A^ 
n 

^ kj^  j-C-Tij  (A)  = CAi'l  1 < i < n 


by  multiplying  both  sides  by  C. 
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Define  the  operator  H : R^-^R^*P  by: 

C 

CA 
CA^ 

ca"~^ 

since  (A,C)  is  an  observable  pair  the  null  space  of  H 
is  j 0 { . 

Since  C • n^(A)  =0  , 1 < i<  n , this  implies 

n 

J<ij  C TXj  (A)  = 0 for  all  1 4 i 6 n 

j = l 

=i>  H ( z ) = 0 , 

This  is  a contradiction  since  z ^ 0 and  the  null  space 
of  H is  j0|  • This  completes  the  proof  of  Theorem  2.2. 

Theorem  2.2  is  not  an  if  and  only  if  statement.  But  ad- 
ding the  condition  that  matrix  C'C  is  invertible  we  have 
Lemma  2.6.  Let  A be  an  nxn  square  matrix,  over  the  reals. 
Let  P be  the  unique  positive  definite  solution  of  the  matrix 
equation 

PA+A'P=-C'C  (2.9) 

where  C'C  is  invertible.  Then  A is  a stability  matrix  and 
(A,C)  is  an  observable  pair. 

Proof : We  have  that  the  eigenvalues  of  C'C  are  non-negative. 

Since  C'C  is  non- singular  this  implies  that  none  of  them  is 
zero  and  threfore  C'C  is  positive  definite.  It  then  follows 


as  in  the  proof  of  Theorem  2.1  that  A is  stability  matrix. 
We  now  show  that  (A,C)  is  observable. 


i- 


solution  P of  (2.9)  can  be  written  as: 

P ,'2  ■ c’c) 

whi'i('  i-i  (x,y)  as  in  (2.4),  is  positive.  From  Lemma  (2.1)  we 
h.ivo  that  there  exists  } n (x)|  which  is  a basis  for  Rp,(x)  and 


q,j(x,y) 


n • (X)  (y) 


=>  P 


f ( > n . (x)  n . (y)  , C C) 

A / j 1 1 


f^(R.  (x)n-  (y) , C'C) 


Uj  (A'  )C'Cti^  (A) 


Since  P ^0  we  have  that 


/.'PX  X ' TTj  (A)  ' C ' CTXj  (A)  z £ ||cnj  (A)  z||  > 0 


Therefore  if  z / 0 we  must  have  ||Cn.j(A)z||  > 0 for  at  least  one 
j in  the  ranq.c  1 4 1 4 n.  Suppose  that  ||  Cn.]^  (A)  z II  > o which 


implies  that  Cn:^(A)z  /-  0. 

Now  I Uj(x)  I is  a basis  for  (x)  , ther  efore  there  exists 


an  invertible  nxn  matrix  K such  that. 

r ni(x)i  r 


Un  (x) 
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Tho  above  represents  n equations  of  the  form 
kiini(x)  + +...+ 


with  j^2  ' ■ ' ' being  the  i 

Therefore : 


; th 


row  of  K. 


f^  (ki]^Ul  (x)  + , . .+kinn,n  (x)  , I)  = A 


i-1 


,i-l 


kiin.j(A)  + kj^2^2  +...+  ^in^n  ~ ^ 

Multiply  both  sides  by  C . 

=>  k^2C'Ti]^(A)  +kj^2^' ^2  *^in*"'^n^^^  ~ CA^"! 

for  1 < i < n 
Lot  A be  the  matrix 


A = 


k lip 

k2lIP 


‘12 


Ip 


k22lP 


>^lnIP 
k2nIP 


>^nlIP  >"n2’^P 


J^nr.IP 


wnoro  Ip  is  the  pxp  identity  matrix. ( Matrix  C is  pxn) . 


A- 


■ 

• ^ 

Cn,  (A) 

C 

CTt2  (A) 

CA 

CUj^(A) 

- 

. 

= L 


We  can  think  of  matrix  L as  a linear  operator  from  R to 
r'^’P.  We  wish  to  show  that  L is  one-  one,  (i.e,  that  the 
null  space  of  L is  | 0 |). 

By  construction  matrix  A is  invertible  since  K is  in- 
vertible, which  means  that  if  w 0 an  n-pxl  vector  then 
A-  w ^ 0 . 


f 
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l,('t  w bo  t ho  voctor: 

Cti|  (A)  z 
Ci>.2(A)/. 


I^Cnn(A)/,  J 

whore.'  /.  / 0 is  an  nxl  vector.  We  do  have  that  w 0 and 

tht'roloro  Aw  / 0.  Rut 

C • z 
CA-z 

A • w = . = L- z 


CA"-^-z 


which  implies  that  the  null  space  of  L is  |0[and  that  (A,C) 
i an  observable  pair. 
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Chapter  3 

Computational  Algorithms 

5 . 1 Introduction 

The  proof  of  Theorem  2.1  is  constructive  and  purely 
algebraic.  It  therefore  gives  great  insight  into  how  a com- 
putational algorithm  should  be  constructed,  for  obtaining  the 
.solution  P of  an  equation  of  the  form 

PA  + A'P  = -Q  (3.1) 

whore  A is  an  nxn  stability  matrix.  The  algorithm  so  con- 
structed, basically  involves  obtaining  cp2(x)  the  character- 
istic polynomial  of  A.  Using  the  Extended  Euclidean  algorithm 
a polynomial  Tjj(x)  as  in  (2.3)  can  be  obtained.  Having  these 
polynomials,  the  polynomial  P(p(x,y),  q^(x,y)  and  the  solution 
P are  formed. 

By  restricting  the  field  of  interest  R,  to  that  of  the 
rational  numbers  F,  the  procedure  for  obtaining  the  exact 
solution  of  (3.1)  is  fully  implementable , using  the  remar)c- 
able  facilities  provided  by  the  computer  programming  system 
HACSYMA  available  at  M.I.T. 

Three  algorithms  are  presented  here,  the  Rational.,  Integer, 
and  Modular,  which  are  based  on  the  constructive  proof  of 
Theorem  (2.1) . 

MACSYMA  (Project  MAC'S  SYmbolic  MAnipulation  System)  is 
a large  computer  programming  system  used  for  performing  sym- 
bolic as  well  as  numerical  mathematical  computations.  This 
would  easily  allow  us  to  malce  parametric  studies. 
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i.2  Th('  Kilt  ioriiil  Ahjorithm 

TtiiM  lilijorithm  is  a more  implementation  of  the  steps 
outlined  in  the  proof  of  Theorem  (2.1). 

:<  I ) Obtain  (P2(x)/  f-he  characteristic  polynomial  of  A. 

(x)  a>2  (y)  ~ tO;  (x)  (y) 


K-p)  Set  I'Jx.y) 


X + y 


Hj)  Using  the  S.-<teiidod  Euclidean  Algorithm  obtain  T^(x)  and  u. 
RJ  Set  q,,(x,y)  T,,  (x ) ( y ) R(p  (x  , y ) modO 


Ri  ) Form  1' 


fA(qu (X'Y) >Q) 


R,  ) Set  P 

tj 


t.  t TUe_In te<j('r  Algorithm 

.Multiplying  A and  Q in  (3.1)  by  a suitable  positive  integer 


iin  equivalent  Iiyapunov  equation 
PA^  + AjP  = 


(3.2) 


1 .s  obtained  with  A],  0^  having  integer  entries.  Suppose 
that  is  the  characteristic  polynomial  of  A^^.  It  is  clear 

that  i|)2(x)  has  integer  coefficients  and  it  can  therefore  be 
considered  as  an  element  of  Zfx,yl  (the  ring  of  polynomials 
n and  y over  the  Integers)  . 


(x)  =CP2  (-x) 


J’^(x,y)  - 


4>2(x)(02(y)  - cp2(x)cp[(y) 


(3.3) 


X + y 


We  clai'i  that  P^(.x,y)  is  an  element  of  Z|x,yl.  Suppose 
ttiat  n is  ofid.  i,L  is  clear  that  for  n-1  or  n=3 
X + y I x'^  + y^ 
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aiui  that  the  quotient  is  an  element  of  ZCx,y]  . Suppose 
then  that  for  all  m<n-l  we  have  that  x+y  | x^"'^^+y2m+l 
and  that  the  quotient  is  an  element  of  Z[x,y].  Show  that 
hypothesis  is  true  for  m=n. 

^2n+l^y2n+l  = (j^2+y2)  (jj2n-l+y2n-l ) _ y^  + y2n-3) 

From  the  induction  hypothesis  we  therefore  have  that 
X y I and  that  the  quotient  is  an  element 

of  zrx,y1.  For  the  case  when  n is  even  we  have  that 
x + y j x'^  - y^i 

and  that  quotient  is  an  element  of  Zfx,y].  Following  the  proof 
of  Lemma  2.4  ii)  we  have  that  P^(x,y)  is  an  element  of  Z[x,y]. 

It  is  also  clear  that  there  exist  polynomials  T^(x), 
and  integer  u'  such  that 

T^{x)(Pi(x)  + A.^(x)cp^(x)  = u'  (3.4) 

with  T^(x)  A.^(x)  having  integer  coefficients. 

Since  the  leading  coefficient  of  <P2(x)  is  unity  division 
by  tP2(x)  is  possible.  If  we  then  let  <I>'  be  the  ideal 
((p2(x),  (P2(y))  in  Z[x,y]  we  have 

q^(x,y)  = T|^(x)TMy)P^(x,y)mod4>' 
being  an  element  of  Zfx,yl.  Consequently 

has  integer  entries  with  the  solution  of  (3.1)  now  being 
expressed  as: 


In  (3.4)  it  is  required  that  polynomials  T^(x),  A.^(x)  and 
integer  u’  be  found  such  that  (3.3)  is  satisfied.  Existence 


I 

I 

J 
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whcro  a,  - 0 for  k>n  and  = 1.  Since  cp'(x)  is  a stability 
k u 2 

polynomial.S  is  positive  definite  ( cf.  BROCKETT) . Since 
(lot  S > 0 it  is  clear  that  for  each  allowable  integer  value 
(jf  u'  there  exist  unique  polynomials  T^(x)  of  degree 

less  than  n such  that 

T|^(x)^p|(x)  + X^(x)<^^(x)  = u’ 


I f 

c - 

= 

+ d2^*^  ^ + . . . + 

then 

d ■ = 

. * n * 
11  ■■■. 

1 4 i 

4 n 

2 

det  S 

where  M .=det  S„i  with  S_.  the  {n-l)x(n-l)  matrix  obtained  from 
ni  nx  ni 

S by  deleting  the  n^^  row  and  i^^  column. 

By  letting  u'=k-(2  det  S) , with  k an  integer  greater  than  zero 
we  have  u'  in  Z and  T^(x),  'r>  Zfx,yl. 

The  Integer  algorithm  proceeds  as  follows. 


I3) 


Obtain  , Q]^ 

Find  (P2{x)  the  characteristic  polynomial  of 


Sot  P^(x,y) 


= (P^  (x)  (p?  (y)  - (Pi(X)cPi'  (y) 


X + y 


r 
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1^)  Find  T^(x)  and  u' 

Ir,)  Hot  qu(x,y)  = (x)T^  (y)  P^(x,y)modHi' 

'Vi  ^ ^Ai 

I -7)  Set  P = . P* 

( u ' ) 

IioLng  all  calculations  in  integer  arithmetic  may  save 
time  since  greatest  common  divisor  computations  will  not  be 
p('r formed  in  intermediate  steps. 
i . 4 The  Modular  Algorithm 

The  integer  algorithm  paves  the  way  for  a modular  approach 
to  the  solution.  Suppose  that  p is  a prime  that  does  not  di- 
vi(ie  2-det  S with  S defined  in  (3.6).  If  Ag  = (^ij)  and 
C>i  - (q . . ) let 

pA  - (a^j  mod  p) 
pQ  = (q^^  mod  p) 

both  ^^A  and  pQ  being  considered  as  matrices  over  Zp,  the  field 
of  integers  modulo  p.  Let  Zpix,yi  be  the  ring  of  polynomials 
in  X and  y over  Zp. 

Let 

p(P2(x)  ^ det(Ix-pA)  pCP2(x)  in  Zplx,yl 
and  p(Pj  (x)  ■=  p(P2  (-x) 

It  c;an  be  easily  shown  that 

p(P2  (x ) = ^2  (x)  mod  p 
pcp^  (x)  = cpj  (x)  mod  p 

'.'here  the  notation  tp^ix)  mod  p means:  reduce  each  coefficient  of 
ip^fx)  modulo  p considering  the  derived  polynomial  as  an  element 


of  Zpl  x,y  I. 
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1,0  I 


,1’  (x,y) 
P u> 


- p^i  (y) 


X + y 

wlu'ro  x>y  is  now  thought  as  an  element  in  Z fx,yl  , the  div- 


ision  done  modulo  p and  being  an  element  of  Z lx,yl 

H ^ H 


1 1 


follows  that  there  exist  polynomials  (x)  , (x)  in 

■ud  u in  Z such  that: 

H P 

pT^j(x)pU)i(x)  f p^u(^)p'P2 " P'" 


whorc^ : 


1 


( X ) = T ' ( X ) mod  p 
P u u 

= Aj|j(x)  mod  p 
pU  u'  mod  p 

■el  pO)  be  the  idea!  ( p(l>2  ^ ^ ^ ' p^2  ^ ^ Zplx,yi 

.ind 

= ^'00  ^ ^10^^  '"01  ^ +•••+  ^(n-l)  (n-l)^"“^y''"^ 

wo  liave  that 

pq^J(x,y)  --=  q'^j(x,y)  mod  p 

1,0  t 

pt,  ■■  p'^ 

} K 

with  all  operations  done  modulo  p. 

I f 

P*  = (q  ) in  ( 3 . 5 ) then 
u 1 j 

p'\i  = <‘Jij 

Now  if  P , ,,u  are  obtained  for  a sufficient  number  of 
p u P 

F)rimes,  the  Chinese  Remainder  Theorem  (cf.  Knuth)  can  be 

used  t f j find  P*  and  u'  making  it  possible  to  obtain  the  solution 
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^ • p* 

2 ^ 
(u’ 


The  Chinese  Remainder  Theorem  is  used  in  the  following 
manner.  Let  and  m2  be  relatively  prime  so  that 

m^>  1112*  Let  = u mod  m^^  and  U2=u  mod  m2  where  0<  u<m2^m2- 

If  c,k  are  integers  such  that 


c-mj^+k‘m2  = 1 


then 


u = (I  c*  (U2-U]^)  Imod  m2)  + Uj. 

Suppose  now  that  m^  = * P2 ' • • • Pn-1 ' '"2“Pn  Pn 

prime  used.  If  u is  some  integer  for  which  we  have  u^  and  U2 

then  we  may  obtain  u mod  m^’m2  by  the  above  procedure  . 

The  way  by  which  we  ensure  that  P*  has  been  constructed 

is,  by  checking  element  wise  at  each  iteration  whether 

P*-A  + A'P*  = -Q  . 
u u 

The  reason  why  the  selected  primes  p must  not  divide 

2-det  s is  because  this  guarantees  that  (x)  , 

relatively  prime  over  Z fx,yl. 

P 

Since  considerable  coefficient  growth  takes  place  in 
intermediate  computations  of  the  Integer  Algorithm  it  may  be 
advantageous  to  implement  the  Modular  Algorithm. 

The  Modular  Algortithm 
M^)  Obtain  p^,pQ 
M2)  Let  p‘P2(^)  “ (Ix-pA) 

M 4 D r ^ p‘^2(><)p‘^2(y)  - p'^lU)p^l(y) 

Ml  bet  P (x,y)  =— El  ± EL  ± fc__± 

■>  p ^ 

X + y 
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M4)  Obtain  pT^_j(x)  pU 

M5)  set  pq„(x,y)  = pT^  (V)  p^cp  "’^V 

) Obtain 
6 P u 

M-y)  Repeat  steps  Mj^-Mg  for  a sufficient  number  of  primes 


and  by  use  of  the  Chinese  Remainder  Theorem  find  P 


c* 
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Chapter  4 

Computer  Programs  and  Numerical  Results 
4.1  1 nt  roduction 

The  three  algorithms  presented  in  chapter  3 have  been  pro- 
grammed on  the  extremely  versatile  computer  programming  sys- 
tem MACSYMA  available  here  at  M.  I.  T.  Each  algorithm  has 
boon  programmed  as  a FUNCTION  on  MACSYMA.  The  function 
.SI,EAMR(N,  PA,  PQ)  corresponds  to  the  Rational  Algorithm,  the 
function  SLEAMI  (N,  PA,  PQ)  corresponds  to  the  Integer  Algorithm 
<ind  function  SLEAMM  (A,Q,PR,N,PA,PQ)  to  the  Modular  Algorthm, 
Evaluating  each  function  at  some  arbitrary  values  of  their 
arguements  one  obtains  the  solution  of  the  corresponding 
Lyapunov  Equation.  We  proceed  now  to  explain  this  in  more 
detail.  (SLEAM  stands  for.  Solution  of  Lyapunov  Equation  using 
Algebraic  Methods. ) 
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4.2  The  Function  SLEAMR 
I'll r [)oso : 

The  v.ilue  of  this  function  is  the  solution  of  the 
I.yapunov  I'quation 

PA  +A'P  = '2  (4.1) 

where  A and  Q have  rational  entries,  with  A being  a stability 
matrix  and  Q symmetric. 

The  arquements  of  the  function 

N = the  dimension  of  the  A matrix 
?A  = the  A matrix 
PQ  = the  Q matrix 

By  evaluating  SLFJAMR  at  N,pa-A  and  PQ=Q  ( ie  SLEAMR(N,  A,  Q)  ) 
one  obtains  as  the  value  of  this  function  the  solution  of  (4.1). 
3'his  is  done  using  the  Rational  Algorithm. 

The  definition  of  function  SLEAMR(N,  PA,  PQ) 
is  sliown  in  Table  (4.1) 


Figure  4.1 


witnnmt 
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4 . 3 The  Function  SLEAMI 
Purpose : 

The  value  of  this  function  is  the  solution  of  the 
Lyapunov  Equation 

PA  I-  A ' P = Q (4.2) 

whore  A and  Q have  integer  entries,  with  A being  a stability 
matrix  and  Q symmetric. 

The  arguements  of  the  function. 

N = the  dimension  of  the  A matrix 
PA  = the  A matrix 
PQ  = the  Q matrix 

By  evaluating  SLEAMI  at  N,  PA=A,PQ=Q  (ie  SLEAMI (N,  A,  Q) ) 
one  obtains  the  solution  of  (4.1).  This  is  done  using 
the  Integer  Algorithm. 

The  definition  of  function  SLEAMI  (N,  PA,  PQ)  is  given 


in  Table  (4.2) . 
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4.4  The  Function  SLEAMM 
Purpose : 

The  value  of  this  funcion  is  the  solution  of  the 
hyapvmov  Equation 

PA+A'P=Q  (4.3) 

whore  A and  Q have  integer  entries,  with  A being  a stability 
matrix  and  Q symmetric. 

The  arguements  of  the  function 

N - the  dimension  of  the  A matrix 
PA=  A - the  A matrix 
PQ=  Q = the  Q matrix 

PR  = A LIST  containing  primes. 

By  evaluating  SLEAMM  at  N,  A,  Q PR  (ie  SLEAMM  (A,  Q,PR, 
N,  PA,  PQ) ) the  solution  of  (4.3)  is  obtained  as  the  value  of 
the  function.  This  is  done  using  the  Modular  Algorithm. 

As  the  computation  progresses  an  integer  is  printed  out  show- 
ing the  number  of  primes  used  so  far.  One  should  malce  sure 
that  PR  contains  enough  primes  for  the  computation. 

A List  of  primes  is  given  in  Table(4.3).  The  definition 
of  the  function  is  given  in  Table  (4.4). 


: I ' •‘•'1  -(-I  ‘H  -<  : I ■'  I '<  » ( ' t ‘ 
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4 . 5 A Numerical  Example 

The  example  corresponds  to  the  evaluation  of 
00 

G = y"  x' (t) • Q • (t)dt 
o 

where  x(t)  is  a solution  of 

x(t)=Ax(t)  x(0)=c  (4.4) 

The  system  modeled  by  (4.4)  is  given  in  Figure  (4.1) 

The  A matrix  of  a system  with  five  blocks  evaluated  at 
f = l,  l•>l  and  M=10000  (a  vaue  assignment  which  forces  the  system 
to  have  characteristic  roots  close  to  the  imaginary  axis)  the 
matrix  Q,  and  the  solution  P of  the  equation  PA  + A'P  = Q 
are  given  in  Tables  (4.5),  (4.5),  (4.6),  respectively. 


Table  4.6 
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4 . 6 The  Parametric  Case 

With  some  minor  alterations  to  the  function  SLEAM(N,  PA,  PQ) , 
the  function  PRMTRC  (N,  PA,  PQ)  was  defined  for  the  purpose  of 
obtaining  a parametric  solution  to  equation  PA  + A'P  = -Q. 

The  definition  of  PRMTRC  (N,  PA,  PQ)  is  given  in  Table  (4.7). 

The  following  example  corresponds  to  the  evaluation  of 


G = 


CD 

/ 


(t)  • Q • x(t)dt 


where  x(t)  is  a solution  of 

x(t)=Ax(t)  x(0)=c. 

The  A matrix  for  a system  as  in  Figure  (4.1)  with  two 
blocks,  the  matrix  Q and  the  parametric  solution  P are  given 
in  Table  (4.8) . 


1 

i 
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Chapter  5 

(.oneralizations  and  Extentions 
'■) . I Th('  Matr[_ix  Rquation  PA^HP'  -C 

W('  now  onipJoy  the  ideas  cJevoloped  in  Chapter  2 to  show 
l.(?nmia  5.1.  Lot  A bo  an  nxn  matrix  over  the  reals  and  B an  mxm 
matrix  over  the  reals,  and  C an  mxn  matrix  over  the  reals.  Let 
cd2  (x)  det  ( Ix-A) 

4^2  ( - det  ( Ix-B) 

(p^  (x)  = (p2  (-x) 

4jj^(x)  =-  4j2(“>^) 

Suppose  that  and  (P2(>^)  relatively  prime  such  that 

A(j(x)4ji(x)  ; Uy(x)cp2(x)  = u 
(x)  4^2  t Uu(x)cp2^(x)  = u 

for  A,j  (x)  , Uu  » ^u  ' du  (x)  polynomials  in  Rrx,yl  and  u in  R. 
And  let 

c,0o(x)4^o(y)  - (Pi  {y)4^i  (x) 

"4.<p(>^'y)  ^tti^ 

i)  P,  (x,y)  is  an  element  of  Rrx,yl  . 

4j(p 

ii)  l.et  fpj^  : Rfx,yl  x — ► I'IN  be  the  action  defined  by 

foA'9(x,y)  ,M)  - ^ M 

whore  is  the  space  of  all  mxn  matrices  over  the  reals. 

Let 

q^tx.y)  = A^(x)u^^(y)P^p^{x,y)mod'}' 
where  W is  the  ideal  (cP2  (x)  ,4^2  R[x,y]  . 

Then 


PA  + BP  = -C 

has  a unique  solution  given  by 


(5.1) 


r 
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L 


Proof  of  i ) . Let 


<^2(x)  = + a^-ix"  ^ + . . • + = fQx"  + 1 + ---+ 


m,  m-1 


(y)  = (-l)“'bny“ 


m-l 


g(x,y)  = </?2  '^2  (y)  S 9jk^*^y^ 

jk 


l„i 


h(x,y)  = v>i(y)^^{x)  = Y, 

il 


i + 1 


+ bi 


'I  X / / \ - ^ -nv  ' ^ ' ~m- 

= eoy""  -r  eiy"’"l  + --'+ 

]n  a similar  manner  to  the  proof  of  Lemma  2.4  , let 


It  is  clear  that  gjj^  - aj^bj  , h^]^  = (-1)  ^ib^ 

Let  b{x,y)  = g(x,y)  - h(x,y)  which  can  be  written  as 


b(x,y)  = gjj^  x^^y^  - hj^j  x^y^ 

0<  i < m 
0<K  < n 

aj^bj  x’^y^  - (-l)^^^aj^bj  x^y^  (5.2) 
is  even  then  the  corresponding  term  in  the  above  sum 

Ic  = min  ( j , k) 

a.b  x’^y'^  - x3“k) 

X 3 

if  j = min ( j , k ) 

akbjX^y^  (x*^"^  - y*^”^) 

And  if  k+j  is  odd  then  the  corresponding  term  in  the  above  sum 
becomes : 

if  k = min ( j , k ) 

akbjX^yk  (y^“^  + x^"^) 


Now  if  k ^ j 
becomes : 

if 


r 


-'jO- 


i I j - ni  i ti  ( i , k ) 

HuL  in  any  case  x+y  will  divide  each  term  (as  in  Lemma  2.4) 
and  the  (jiiotient  of  b(x,y)  divided  by  x + y will  be  the  sum  of 
the  quot.ii'riLs  obtained  by  dividing  each  term  in  the  sum  (5.2) 
by  x+y. 

erocd  of  ii).  The  proof  will  proceed  in  throe  steps. 

SLc'p  l.  Wo  I i‘3t  some  properties  of  action 

i)  r|^^(u,M)  - uM  whore  u is  a unit  in  ^(x,yj 

ii)  ^ h(x,y)  , M ) = fg^(g  (x,y)  ,\^) +fy,^(h  (x,y)  ,M) 

iii)  fH;^(q  (x  , y ) h (x , y)  , y)  = f (g  (x , y ) , f 53;^  (h  (x , y ) , M)  ) 

= fBA(h (x,y) , fRA(g (x ,y) ,M) ) 

iv)  ■ fsA  (g 

V)  fR?.  (q  (x,  y)  ,M  + N)  ==  f BA  <g  (x  , y ) , M)  + ffiA  (x  , y)  , N) 

A1  I t lie  above  are  analogous  to  the  properties  of  the  action 

f^  and  in  the  case  when  B = A'  then 

f,3^(g  (x,y,M)  = r^(g(x,y),M) 

lot  all  q(x,v)  in  K[x,y]  and  M in  P|. 

I'rf)(jert  ies  i),ii)  and  v)  are  quite  clear.  We  now  show 

that  [;roporty  iii)  holds. 

L.et  . 

g(x,y)  h(x,y)  ^ hij^xlyi 

jit  il 

q(x,y)  = g(x,y)h(x,y)  = ^ 

St 


= E ^ L 9jkhil)>^^y® 

St  i+',  = s 
k + l=t 


St 


E ( E '^jkh.^)  B^MAt 
St  i I i -5; 
k 1 1 t 

jk 

f|^^(h(x,y)  ,fgA(q(x,y)  ,M)  ) = ^ g j 

il  jk 


i + 3MAk^l 


-E  E >'ii5ik'=‘'"“ 

il  jk 


I ft  s-i  + j 


t=k  + l 


= E ( E 


St  i + ] = s 
k + l = t 


=feA(q (x,y) ,M) 

Iv'c  now  show  property  iv)  . 

Any  polynomial  h(x,y)  in  R|x,yl  can  be  uniquely  written  as; 
h(x,y)  - a(x,y)(P2(x)  + b(x,y)ij;2(y)  + r(x,y) 
whc'ro  the  degree  of  r(x,y)  is  less  than  m in  y and  less  than  n 
in  X , by  first  dividing  h(x,y)  by  cp^(x)and  then  dividing  the 
remainder  by  (x ), Therefore 


fBA(h(x,y)  ,M)  = fj3A  (a  (X/y)  ^2  ^ ^BA  ^ ^ ^2  (v)  »M) 

+ (x,y)  ,M) 

= Iba  ' ^BA  (^^2  »M)  ) 

+ fBA(J=*<5^'y) ' fBA('i^2  (y)  »M))  '-fBA(*^(^'y^ 
ffiA  fa  (x,y)  ,M(P2  (A)  ) + f ba  (t>  (x  , y)  , 4^2  (B) '^) 

"ba  (r  (X  , y)  ,M) 

- I BA(r  (x,y)  ,ri)  = fBA(h  (x,y)modT,M) 
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b.'causo  of  the  Cayley-Harramilton  Theorem. 

.Step  2.  .Since 

qu(x,y)  = Ay  (x)  (y)  Pj^^(x,y)modT 

wc  will  have 

(x  + y)(Ay  (x)Uj;j(y)P^^(x,y)  ) = A^  (x)  Uy  (y)  (cP2  (x)  0^2  (y)  ~^1  (Y)  *^1  ) 

= A^(x)u^(y)0J2  (x)0^2  (y) 

- A^^(x)Uy(y)<l>i(y)aj2^(x) 

= A^  (x)  (y)  (P2  (x)  v1j2  (y) 

(u-Uy  (x;  (P2  (x)  ) (u-A^  (y)  0^2  (y)  ) 

= Ay  {x)u^(y)(P2  (x)0j2  (y)“U^+uA^  (y)0^2  (y) 

+ uUy  (x)  (P2  (x)  -Uy  (x)  A,^  (y)  (P2  ^2  (y> 

which  implies  that 

(x fy)qy (x,y) )modT  = -u^ . 

Step  3.  We  now  show  that 

P = -^2' 

is  the  unique  solution  of  (5.1). 

PA  + BP  = (fg;^(qy  (x,y)  ,C)A  + Bf  (q^  (x  , y ) , C ) ) 

1 

u ' 

1 

1 


= J (fsA^  ' 
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IJniquenoss  follows  by  observing  that  the  linear  operator 
I,-.  defined  by 

L(P)  = PA  + BP 

is  onto  since  no  restriction  was  placed  on  C.  This  implies 
that  L is  one-one.  This  completes  the  proof  of  Lemma  5.1. 

We  have  shown  that  PA  + bp  = -C  has  a unique  solution  if 
(x)  and  relatively  prime  where 

l)2(x)  = det(Ix-B) 
tP2  (x)  = det  ( Ix-A) 

(x) 

The  usual  statement  of  this  theorem  [cf.  Bellman] 


is  as  follows. 

The  equation  PA  + BP  -C  has  a unique  solution  for  all 
C if  A^+Uj  f 0 where  A^  are  the  characteristic  roots  of  A 
and  Ui  the  characteristic  roots  of  B. 

We  end  this  section  by  showing  that  these  two  statements 
are  equivalent. 


Assume  that  ^Jj2^(x)  and  CP2  (x)  are  relatively  prime. 

Suppose  then  that  there  exist  i,j  such  that  A^+u^  = 0.  This 

means  that  A.  - -u  . which  implies  that  il,(x)  and  tp„(x)  have  at 
13  1 2 

least  one  root  in  common . This  in  turn  implies  that  U^^^Cx)  and 
m2(x)  have  a nontrivial  common  divisor  which  is  a contradiction. 
Assume  on  the  other  hand  that  0 for  all  i,j. 


Suppose  then  that  there  exists  a k(x)  of  degree  greater  than 
or  oc^ual  to  one,  such  that  k (x)  | (x)  and  k (x)  j • 

This  would  imply  that  l/j^(x)  and  tP2(x)  have  at  least  one  root 
in  common  which  contradicts  our  initial  assumption. 


i 


I 
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Tho  above  suqqests  an  algorithm  for  obtaining  the  sol- 
ut  ion  of  equation  (5.1).  As  in  the  case  of  the  Lyapunov 
equation  (3.1)  Rational,  Integer  and  Modular  versions  of 
the  algorithm  can  be  constructed  in  a similar  manner. 

Algorithm  for  solving  equation  PA  + BP  =-C. 

Aj)  Obtain  ii>2(x),  i1t(x)  the  characteristic  polynomials  of 
A and  B respectively. 

m2(x)i(^2(y)  “ <Pi  (y)  (x) 

A^)  set  P^^(x,y)  =--^ 2 1 1 

X + y 

A^)  Using  the  Extended  Euclidean  Algorithm  obtain 

A^)  Sot  q^(x,y)  = ^u^^^ 

A5)  Form  P^  = fg^(q^ (x,y) ,c) 

A.)  Set  P = _J_  • p 
u2  u 
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5.2  Conclu:Tions 

In  closinq  we  wish  to  comtnent  on  what  has  been  accom- 
1 i she'd  by  this  thesis,  point  out  some  disadvantages  associated 
with  the  method  used  in  solving  the  Lyapunov  equation  and  dis- 
rii.ss  .several  possibilities  that  can  be  persued  in  the  future. 

Wo  have  constructed  purely  algebraic  algor.i  t.hms  for  obtain- 
imi  the  exact  solution  of  the  Lyapunov  equation.  The  algebraic 
structure  on  which  the  methods  are  based  is  quite  rich  and  can 
further  be  exploited.  The  algorithms  are  quite  simple  requiring 
no  obscure  a]i|obraic  constructions,  (the  Extended  Euclidean 
.'■Igorithm  providing  a basis  builfling  block)  and  as  demonstrated 
fully  implementable  on  existing  computers. 

The  price  we  had  to  pay  for  an  exact  solution  takes  the 
form  of  coefficient  growth,  creating  space  requirements.  The 
cr if  Leal  parameters  which  did  ate  the  amount  of  storage  required, 
a r(':  d i mens  ion  of  the  A matrix  as  well  as  the  size  of  the  entries 
lu  both  the  A and  the  Q matrices.  The  problem  of  space  has 
ejuite  adequately  been  dealt  with  by  the  introduction  of  the 
Modular  algorithm.  But  in  doing  so  the  excecution  time  is  in- 
creased. In  this  thesis  no  serious  time  complexity  evaluation 
is  prc'sented. 

In  most  engineering  situations  an  exact  solution  is  not 
required,  but  merely  a five  or  ten  digit  aoproximation . Exist- 
i nc)  methods  completely  neglect  the  question  of  accuracy  in  the 
approximation  to  the  solution  of  the  Lyapunov  equation.  Because 


of  the  nature  of  the  mc'thod  presented,  which  results  in  an  exact 
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solution,  it  is  quite  possible  that  a closer  examination  may 
rt'veal  a scheme  by  which  some  control  can  be  exerciseil  on  the 
accuracy  of  the  approximation.  As  exhibited  by  the  parametiic 
f'x.iiiqjle  included  in  chapter  4 our  method  offers  great  possibil- 
ities f(rr  parametric  studies. 

Wo  have  extended  the  results  and  suggested  algebraic  methods 
f)f  solution  for  the  more  general  matrix  equation 
PA  + BP  ^-1’. 

The  Riccat i equation  did  come  under  consideration  and  some 
lie;;;  important  2,«2  examples  wore  soved  by  Newton's  Method  with 
our  m>'thod  being  employed  in  the  solution  of  the  intermediate 
tyapunov  equations.  The  problem  encountered  hindering  further 
pioijress  was  again  that  of  coefficient  growth.  It  was  felt 
tP.it  that  in  order  to  attempt  more  realistic  examples  it  would 
be  wi.se  1.0  i?ithc'r  first  devise  a method  for  obtaining  appoxi- 
mate  solutions  with  controlled  accuracy  or  re-examine  the 
Riccat  i equation  under  the  light  of  the  present  work. 

Finally  wo  have  gained  great  insight  from  all  this  work. 

We  feel  that  this  is  only  the  begining  of  a more  serious  study 
on  the  computational  aspects  of  Control  Theory. 


i 

I 


J 
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APPRNDIX 

This  Appendix  contains  the  proofs  of  Lemmata  (2.1),  (2.2), 

(2.))  and  (2.4)  found  in  section  (2.2). 

^emma  2^1.  Let  p(x,y)  be  a polynomial  in  R[x,yl  with  C(p) 
beinq  an  mxm  matrix.  Then  p(x,y)  is  positive  if  and  only  if 
there  exist  polynomials  n (x ),...,  (x)  such  that 

ni 

P(x.y)  = Y,  TXi(x)n^(y) 
i=l 

where  | rij^(x)  } are  a basis  for  Rj^(x). 

proof : Suppose  that  p(x,y)  is  positive.  This  implies  that 

C(p)  is  positive  definite  and  symmetric.  From  linear  algebra 
I 7 I we  have  that 


C(p)  = V • V 

for  some  real  mxm  matrix  V=(v^^j).  This  implies  that  det  V ^ 0 
and  therefore  V is  invertible, 
since  p(x,y)  = 1 ' (y ) C (p) 1 (x) 

= (!'  (y)  -V)  • (V  . (x)  ) 

let  Tij^(y)  = v^^;^  + V2iV  + +...+  ^ 

and  Tt^(y)  = v^^^  + V2iy  + ...  + Vj^iy"’”^ 

1 4 i 4 m 


and  we  have 


Lot  q (x ) 


m 

p(x,y)  = Yi  ^i<y)  M 
i = l 

be  a polynomial  in  R^^(x). 


g(x)  = qi  + g2X  +... 

Since  V is  inverible  it  has  m linearly  independent  columns 


I Vj  } which  form  a basis  for  all  vectors  of  length  m. 


such  that 


Wi'  ttu'i('lor('  h.wt'  rt'al  uuinbors  ..o^ 


which  equivalently  is  written  as: 


(j(x)  ■=  a^-iij^(x)  + d2n2(x)  +...  Oj^-n^(x) 

ni 

- E 

i 1 

th(!refore  | (x)  } form  a basis  of  R|^(x). 

Suf)p<xH(^  now  that  there  exist  polynomials  (x ) , n2  (x ) , . . . (x ) 

lormirui  a basis  for  R^(x)  such  that 

ni 

!>(x,y)  = n.i(x)  Ml-  (y) 

i =1 
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i 


W('  can  therefore  write  p(x,y)  as; 


[J  ( X , y ) =11,  y 


,m- 1 


n 


n’ 


1 

X 


,m-l 


wh('re  the  column  of  n=  (n.  .)  is 


^il 


i2 


n. 

im 


.sLnc('  |n^(x){  form  a basis  we  must  have|n.^[  being  linearly 
independent  and  detll  ^ 0. 

1 also  claim  that  the  largest  power  of  p(x,y)  in  x or  y 
is  m- 1 . Since  if  we  assume  that  there  are  no  terms  in  p(x,y) 
which  arc  of  degree  m-1  in  either  x or  y wo  must  have 


m 

^ ^im 

i = l 


0 


imply!  nij  that  n.  =0  , 1 ^ i 4 m , and  therefore  a contradiction 
im 

to  the  hypothesis  that|nj^|  are  linearly  independent. 


This  ensures  that  C(p)  = n • 11'  and  that  it  is  symmetric 
and  p'vsitive  semidc  f in  i l e . 

Assume  now  that  there  exists  some  vector  z ^ 0 such  that 

/, 'lin’z  = 0 

Since  (7  is  inverible  this  cannot  happen  and  therefore  C(p)  = 17  •17' 
is  positive  definite. 


I 
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Lemma  2,2,  Let  n be  the  deqree  of  cp(x)  , if  p(x,y)  mod® 
is  positive  of  degree  n-1  in  both  x and  y then  o(x) o(y ) p (x , y) mod® 
is  positive  of  degree  n-1  in  x and  y , if  and  only  if  cp(x) 
and  0(x)  are  relatively  prime, 

proof:  The  proof  will  proceed  in  three  steps, 
step  J^,  We  first  show  that  there  exists  a vector  space  iso- 
morphism between  Rn(x)  (the  vector  space  over  R of  polynomials 
of  degree  less  than  n under  addition)  and  the  quotient  space 
Rl  X | .(o(where  y>=  {<P(x)  ) considered  as  a vector  space  over  R 
under  addition,  (Rlxl/tp  is  actually  an  algebra  if  we  also  include 
multiplicity.) 

Let  t:  R (x)  — ► Rfx]/(P  be  defined  by 
n 

t (g  (x)  ) = cp+g  (x)  . 

It  is  a vector  space  homomorphism  since 

t(ct^gj^,(x)  + a2g2(x))  = Oj^t(gj^(x)  + a2t(g2(x)) 

Let  >p+  g(x)  be  an  element  of  R[xl/cp,  if  g mod<p  denotes  the 
polynomial  in  cp+g(x)  of  minimal  degree  (which  must  be  less 
than  n)  we  have 

t(g  mod  (P)  = (p  + g mod  <P  =cp  + g(x) 

Let  g^  (x)  ^ elements  in  Rj^(x),  Then  it  is  clear  that 

(P  + g^(x)  ^ (p  + g2(x)  and  this  shows  that  t is  an  isomorphism, 
step  2,  We  now  show  that  if  | iXj^{x)  j 1 ^ i < n is  a basis 
for  Rj^(x)  then  | «t(x)n:^(x)  \ is  also  a basis  for  Rj^(x)  if  and 
only  if  (P(x)  are  relatively  prime. 

If  I f^j^(x)  I is  a basis  for  R^Cx)  then  (p  + tij^(x) 
is  a basis  for  R(  x ]/(P, 
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SiipF>oso  that  n(x)  , (P(x)  are  relatively  prime  . This 

implies  that  there  exists  A(x)  in  Rj^(x)  such  that 

(<P  + '^(x)  ) • (<P  + o(x))  = (P  + 1 

where  ^P+l  denotes  the  multiplicative  indentity  in  R[x]/<P 

For  any  coset  + a(x)  there  exist  in  R such  that 

n 

(<P  + '^(x))-  (0)  + a(x))  = X)  (cp  + Ti^(x)) 

i=l 

n 

= ((P  + 1)  ' { 2]  k^  (cp  +n  ^ (x)  ) ) 

i=l 

n 

= ((P  + k(x))’(  ^ kj^  (cp+o(x)  (x)  ) ) 

i-^1 

n 

(<P  + a(x))  = ^ k.  ((p  + o(x)n,  (x)  ) 

i=l  ^ 

and  therefore  |(p  + o(x)n^(x)}  is  a basis  for  Rfx]/cp  . By 
step  1 we  have  that 

I (o(x)  (x)  ) mod  <p  } is  basis  for  • 

Suppose  that  o(x)  , cp(x)  have  a nontrivial  factor  in  common, 

ic  there  exists  T(x)  in  Rj^(x),  (cp+T(x))/  0 such  that 

(cp  + T(x))‘((p  + o(x))  =(p  + 0 

where  cp+0  is  the  additive  identity  in  R[x]/cp. 

Suppose  then  that  |a(x)n.j^(x)  mod  cp|  is  a basis  for  Kj^(x). 

(cp+T(x))  = (cp  + x)’(cp+l) 

n 

" (cp  +T(x))-  k^  ((P  + o(x)n^(x)  mod  cp) 

n 

^ ]C  t (x)  o(x)  Tt^  (x)  ) 

i=l 


(P  + o 
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v/hich  is  a contradiction.  This  proves  step  2. 

Step  i.  We  now  prove  the  le'Tima.  If  pmod^  is  positive  then 

n 

pmod<I>  = nj^(y)a^(x) 

n 

<I>  -*  p'nodO  =0+  ( Y,  ’•’i^y) 

n 

+ o (x)  o(y)  (pmod®)  = O Y {o(y)rtj^(y))(a(x)n.^(x)) 

i=l 

n 

If  ■ o(x)  o(y)  p (x,y)  = 0)  + Y (o(y)  (y)  ) (o(x)  n.^  (x)  ) 

i 1 
n 

(o(x)  o(y)p(x,y)  )mod<I'  Y ( (o  (y ) (y ) ) (a  (x)  (x ) ) ) mod® 

i=l 

n 

o (x)  n (y ) p (x  ,y)  mod®  - ^ a (y)  n.j^  (y ) mod®o  (x)  (x)  mod® 

i^l 

From  Lemma  2,1  and  step  2 a (x)  o (y ) p (x , y ) mod*  v;ill  be 
r’ositive  of  degree  n-1  in  x and  y if  and  only  if  o(x)  (x)mod® 
form  a basis  of  Rj^(x).  This  completes  the  proof  of  Lemma  2.2, 
l,('nma  2.3.  Let  A],A2,...A.^  be  complex  numbers  which  are  distinct 
and  have  positive  real  parts.  Then  the  nxn  matrix  = 


is  hermitean  = A*  where  (*)  the  hermitean  adjoint)  positive 

de  f ini te . 

proof-  We  first  show  that  if  the  mxm  matrix  Aj^  = 


positive  definite  so  is  the  mxm  matrix  S,^ 

that  each  Cj^  ■/  0. 

Lot  .Sj^  be  defined  as: 


/ CjCj  \ 


IS 


provided 


'ci 

0 

0.  . . 

0 ■ 

r 

0 

0 

...O' 

0 

C2 

. . . 

0 

0 

^2 

g 

...  0 

Si  = 

0 

0 

c 3 • • 

• 

^1 

0 

0 

1 

= 3 

...  0 

_0 

0 

• ■ • 

^1. 

_ 0 

0 

0 

...  C 3 

] 


I 


r 
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where  In  order  for  Sj^  to  be  positive  definite  we  must 

have  detSj>0  for  l<l<m  (Sylvester  Criterion). 


1 


detSi  = ( 


-1 11  ""i' 


Since 


c^)  dot 
i-1  i-l 

0 and  A is  positive  definite  we  have  that 


detSj^  > 0 for  1 < 1 < m 

This  therfore  ensures  that  if  An-1  positive  definite 

so  is  the  matrix 


"n-1 


/ 1 _ \ 

(Xi+Xfj)  (Xj+Aj^y 


We  now  prove  the  Lemma  by  induction  on  n. 

It  is  true  that  Aj^-A*  for  all  n since 


^n  ~ (^ij)  ^ 


Xj+Ai 


Xi+Xj 


) = (aij)  = 


‘n 


where  c^j  = aji  . It  is  clear  that  A^  > 0 since 

_1_>0 


Xi+Xi 


Suppose  that  A^^  > for  all  m<n-l.  Applying  the  Sylvester 
Criterion  on  A^^  we  see  that  all  determinants  of  intermediate 
minors  are  positive,  by  the  induction  hypothesis.  We  just  have 
to  show  that  detAj^>0.  By  observing  the  structure  of  and 

using  elementary  properties  of  determinants  we  now  show  that 


and 


-6^  - 


" 1.  ■ 

1 

1 

D 

+ 

>- 

3 

1 

— — 

1 

Xi+Xi 

(Aj^  + An)  (Xj^  + Aj^) 

Ai+In 

1 

-(A^  + A ) 
n n 

1 

A2+Ai 

Ci  - 

(A2+Xj^)  (Ai+Aj^) 

a = 
n 

^2+^n 

1 

-(An+An) 

1 

^n-1 

An-i+An 

Then 

Kn— ] *"  t>2'^C2/-*"  ^n”l"^^n“l^ 

and 


det  Kj^_-[  - det  Cb^,  b2»...  b^-l^  <-det  Ccj^ , b2  , b^  « . . • bf^_j^  1 
+ .,.  +ldet  bj,b2/... 

'=  det  fb^,b2,-.. 


r 


dot  K 


A.  i A 
n n 


n-1  r +1 


A,  +An 


det  I -a^,  b2,  . . 1 


A-  +A 

2 n 


det  fbj^,  -a^,  . . .b^_j^  J 


^n-l+^n 


det  fb^,  b2,...bj^_2,  -a^: 


det  Cb2^  b^f***  1 ^ ^ 


+ (-!)"  ^ — det  [b  , b3,..,bj^_l^  a^^  ] 


I-  ... 


A„  + A 
n n 


[bj^f  b2»**  - b^_  2 1 


Expanding  det  by  the  last  row  gives: 

det  = (-1)''  + '^  det  Cb2,  b3/---bj^_l.  ] 

Ai  '‘An 


+ (-1)2*^  I det  Cb^,  b2,...bj^] 


and  therefore 


i det  Kj^_3  = det 
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Since  is  positive  definite  and  has  positive 

real  part  we  have  that 
det  A^>  0 
and  that  > 0 . 

We  can  also  note  as  a consequence  of  this  lemma  that  if 
AjA2...A^  are  complex  numbers  with  negative  real  parts  then 

_u2 

the  matrix  = ( ) where  u ^ 0 is  a real  number  is  also 

^ Ai+Xj 

[positive  definite.  This  completes  the  proof  of  the  Lemma. 


-67- 


l.iMimi.i  7.4.  1,1'L  A bo  an  nxn  .stabilit.y  matrix  with 

|i.,  (x)  (lot  (fx  - A)  and  lot  ® '^2*V))-  Define 


<()|  (x  • h>2  (-X  ) 

ip2(x)u)2(y)  - (x)  4)^  ty ) 

I>  (x  , y ) --  

‘P  X -t  y 


(2.1) 


) Polynomials  cPj  (x),cP2  (x)  are  relatively  prime.  That  is 

there  exist  T (x),A  (x)  in  Rlx,yl  such  that 

u u 

'I'  ( X ) CP,  (x ) + A (x ) (P.,  (x - u (2.3) 

u 1 u ^ 

where  u is  a unit  in  Rlx,yl. 

ii)  P (x,v)  is  an  eleiient  of  R[x,y]  . 

(P 

iii)  Let  q^(x,y)  = (x ) (y ) (x , y ) mod  iP  (2.4) 

Then  c}y(x,y)  is  positive  of  degree  n-1  in  both  x and  y. 

Proof  of_^) . Suppose  that  there  exists  a k(x)  of  degree 
t)rc!ater  than  or  equal  to  1 such  that 
Ic.  (x)  1 cpj  (x) 

(Pj  (x)  lj(x)k(x)  cP2(x)  = l2(x)k(x) 

this  implies  that  <P]^  (x)  and  <02(x)  have  at  least  one  common 
root,.  This  cannot  happen  since  (Pj^(x)  ;p2(“^)  ^nd  cp2(x) 

is  a stability  polynomial.  Therefore  no  such  k(x)  exists  and 
‘P]  (x),cp2(x)  are  relatively  prime. 

)’roof_of  i i ) . 

Let 


k (x)  I (P2  (x) 


(P2  (x) 


a Q + a j X + 


+ a^x* 


(P^  (x)  - ag  + (-l)a]^x  + ...  + (-l)^a^x''* 


q ( X , y ) 


<p2  (x)cp2  (y) 


jk 


Let 


fi  (x  , y ) 


'•’i  (y)  Y1 

i 1 

b(x,y)  -•  q(x,y)  - h(x,y)  = ^ b^^x^y^ 

St 

where  =•■  - (-1 ) ■ (-1 ) ^a.j 

, , . t+s 

= a^a^  - a^a^{-l) 


I.et 

s^t= 

m 

0 4:  ni  4 n 

b„ 

1 1 \ 2m 

" ( 1 ) ~ 

0 for  all 

m. 

mm 

m 

mm 

bet 

s~m 

. t-  k , 

, 0 < m < n 

0 < k < n 

, m/k 

mk 

- 0 if  m;-k 

Gven 

- 2a„a,  if 
m k 

m^'k  oHd 

1 t c 

an  bt' 

shown 

by  induction 

that 

i ) 

xay  1 

^ m 
X + y 

if  m 

is  odd 

1 1 ) 

xt-y  I 

. m_ym 

if  m 

is  even  . 

With  this  in  mind  and  that  b(x,y)  is  symmetric  the 
iivision  of  b(x,y)  by  -:+y  is  performed  by  summing  the  quotient:; 
obLainotJ  from  the  divisions  of  all  terms  of  the  form 

Ir  m m 

'■mk“  y ^ 'Jkm^  V by  x-.'y. 

PixK)_f  of  i i i I , 

The  proof  wili  proceed  in  three  steps, 
step  Assume  that  the  eigen- values  of  A , . . . A^^ 

are  all  distinc:t.  Show  that  q^(x,y)  is  of  degree  n-1  in 
both  X and  y and  that  it  is  positive. 

.Sinc'o  P^^(x,y)  is  symmetric  so  is 

h\,(x,y)  --  ,'T^j(x)T^(y)P^(x,y)  ) mod 


i 


I 
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On  tho  other  hand 

(x*y)  • (T^j(x)T^^(y)P,p{x,y)  ) = T^(x)T^_j(y)  1 9>2  (x)  9>2  (V)  <V)  > 

= T^^(x)T^{y)(P2  (x)cP2  (y)  - (x)  (y)  cp^  (x)  (Pj^  (y) 

= (T^_,(x)T^{y)  - A^(x)  A.^(y)  )cP2(x)(P2(y) 

+ uA  (x)cp^(x)  + uA  (y)cp  (y)  - 

U ^ U 2 

which  implies  that 

2 

( (x+y) -q^{x,y) ) mod  ® = -u  (2.5) 

In  order  for  this  to  happen  the  degree  of  q^(x,Y)  in  both 
X and  y which  is  less  than  or  equal  to  n-1,  must  actually  be 
n-  1 . 


On  the  other  hand 

(A  + A ) . q (A  , A ) = -u‘ 
i ^ u X j 

and  therefore 


qu(^i»  ^j) 


-u2 

A . + A . 
1 J 


Since  we  have  assumed  that  the  A^ ' s are  distinct  then 
l(Aj),  1 (A2)  , . . . , 1 (Aj^)  by  the  Van-dermonde  determinant 
theorem  must  be  linearly  independent  vectors. 

We  now  wish  to  show  that  C(q^{x,y))  is  positive  definite. 


Let  z ^ 0 
z ' ( (q 


) z = ( ^ k 1'  (A^))  C(q  ) X;  k.l(A  )) 

^ itl  ^ “ j = l ^ 

n n _ 

= Z E !• (Ai)  C(qu)l{Aj 


i=l  j=l 
n 


n 

= E 


X kikjq^(A.,  A.) 

i=-l 


- /o- 


|k_,  k^...R„l 

2 

With  K ^ (q  ( A . , A . ) ) = ( — ) 

^ J A.-+A. 

1 J 

Sinc«'  /.  / 0 not  all  of  the  k.’s  arc  zero.  Lemnta  2.1 

1 

('nnures  us  that  K^is  positive  definite  and  therefore 

z ' t,'  (q^  ) ^ 0 if  ZT^O 

niakiiK)  C (q  ) positive  definite, 
u 

stf'fi  2.  Since  (x)cp  fy)T  (x)T  (y)P(p(x,y)  modo  = PcpCx,'/)  mod<t) 

1 ' U U 

W('  also  have  P(,(x,y)  mod  '1'  = Pj^{x,y)  beinq  positive  as  a 
consetiucncc  of  I.cmma  2.2. 

stop  1.  Suppose  now  Lhat  the  eigen-values  of  A are  not  distinct. 
Stiow  that  (x,y)  is  positive. 

In  order  to  simplify  the  notation  we  let 
V (x)  = (O2  (x) 
ilj'^  (x)  = (x) 

All  we  have  to  do  in  showing  that  q^j(x,y)  is  positive  is 
to  show  that  Pj^,(x,y)  is  positive.  Then  by  hemma  2.2  it  is 
assurt'd  that  q^(x,y)  is  positive. 

Wo  prove  that  Pjp(x,y)  is  positive  by  showing  that  it 
c-an  be  expiresses  as: 

n 

P,.o(x,y)  = X 
i ■' 

whoro  jr.(x)|  is  a basis  for  R (x) . 
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Wr  i L(' 

^(x)  - (x)^2 

v^hori'  I'dch  ^^(x)  has  distinct  zeros  and 

*s|Vl  '*'a-lj  '"s-2--- 

We  then  have 

I>(p  ( X , y ) ,-Z_JiLix.)j|''*'  (y)  • 

X + y 


We  know  that  the  degree  of  Pjp{x,y)  is  less  than  n in  both 


X and  y. 


I.et  rij(x)  Ojj(x)02(x)  . . . ifi  ^ ( x ) • 0 j ^ (x  ) . . . 


(x) 


for  ] < j < s. 


i f WC'  1 t 


i^-(x)0;-(y)  - (x)  liJ . (y) 

P (x,y)  J ^ ^ 3 — 

1 X y 


it  can  be  shown  that 


!>(x,y)  - Y,  'ij  (y)P^j,  (X, 

11  ^ 


y) 


by  substituting  in  the  expression  what  h^  (x)  and  Pj|^  (x,y) 
arc'  and  cancelling  terms. 


Prom  step  2 we  know  that  each  P^j,  (x,y)  is  positive  and 

j 

t hc' ref (3 rc"  by  Lemma  2.1 


k-  1 


whe  rc 


■ n is  the  degree  of  c|c.,'x)  and  jn.,  (x)[  are  a basis  for 
I D ' :k  ’ 


(X). 

■) 


There;  fore 


H n. 


‘’,p(x-y)  E E^  n^(x)n.j^(x)  •n.{y)n.^{y) 
■)-]  k^l 


Wg 


show  that  (x)  n, . (x)}  is  a basis  for  R„(x). 

' T Dk  ’ ^ 

Suppose  that  there  exists  real  numbers  m . not  all  zero 


such  that 


j=l  k=l 


Wo  can  write  this  as 


s-l  nj 
j-1  k-  1 


k=l 


if  all  m 1 < k < are  zero  we  can  proceed  by  writing 


s - 2 n , 


ns-1 


E E'^jk'^j  " E "'s-lk'^s-l(^)^s-lk(^) 


j=l  k=l 


k=l 


and  continue.  Suppose  then  that  j=s'  is  the  first  time  that 
we  encounter  non  zero  elements  in  1 ^ k < rig  i . Then 


(*) 


s'-l  ng'  ng. 

E E = E "'s'k’^s' 

j=l  k=l  k=l 


Multiply  both  sides  by  bg,(x)  = (x)  iii2  (x)  . . .lig  i (x) 

The  right  hand  side  of  (*)  can  then  be  written  as; 
p (x)  -cp{x) 


and 


for  some  p(x) 


n=  I 


^s'  "’s  ' k^s  ' ^s  ' k ~ p(x)-(p(x) 

k=l 
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if  p(x)  - 0 wo  thon  have  that 

Og  ' 

hgi  (x) -bgi  (x)  • 2 rns  ' ' k (x)  = 0 

k=l 

But  since  |n.gi)^{x)|  are  a basis  for  (x)  this  would 

imply  that  111^  i j,,  = 0 , 1 < k < Ugi  contradicting  the  assump- 
tion that  j = s'  is  the  first  such  j for  which  not  all  ^gi]^~0’ 
Suppose  then  that  p(x)  f 0- 
This  would  mean  that 

ns ' 

cp(x)  I bg,  (x)  "’s  ' k’^s  ' ' k 

k=l 


or  that 


lljgi  (x) 


(Jjl  (x)  *0^2 


mg  I kTtg  I k (x ) 

k=l 


But  Oj  , (x)  and  0^^  (x)^Jji  (x)  . . . O^s'-l^^)  relatively 


prime  threfore 

^g,  (x)  I 


^s- 

E 

k -1 


ns ' 

Since  the  degree  of  ^ ' k^  s ' k less  than  ns' 

k^l 

ns* 

this  can  only  happen  if  ^ iris ' k^  s ' k = 0 or 

k=l 


equivalently,  when  mg  1 = 0 for  1 < k < ng . . 

This  again  leads  to  a contradiction  since  we  have  assumed 
that  j = s'  is  the  first  time  we  have  m^,j^  , 1 < k ^ ngi  not  all 
being  zero. 


-74- 


The  process  is  repeated  until  all  m are  shown  to  be 

ik 

zero  contradicting  our  original  assumption. 

Therefore  In  (x)n  (x)f 
j jk  ’ 

is  a basis  for  R^(x),  and  P^(x,y)  is  positive.  Since 

n=n j +U2+ . . . +ng  we  also  have  that  P^(x,y)  is  of  degree  n-1  in 

both  X and  y. 

This  completes  the  proof  of  step  3 and  the  proof  of 
Lemma  2.4. 
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